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PRODUCING AROMATIC "PAINTING" EFFECTS TN IMAGES ^ 



Field of the Invent 



i<^ 



The present invention relates to an image processing 
method and apparatus an&, in particular, discloses a Producing 
Automatic "Painting" Effects in Images. 

The present inventio 1 ^ further relates to tlr^ field of 
image processing and in \particular to producing artistic 
effects in images. 
Background of the Invention 

Recently, it has become c^uite popular/ to provide filters 
which produce effects on images similaj? to popular artistic 
painting styles. These filters ^are designed to take an image 
and produce a resultant secondary^ im^ge which appears to be an 
artistic rendition of the primary ^fnage in one of the. artistic 
styles. / \ 

One extremely popular arti/st ir\ modern times awa^'" Vincent 
van Gogh. It is a characteristic of art works produtecT by this 
artist that the direction of/brush stroNkes" in flat areas of his 
paintings strongly follow /the direction of edges of dominant 



features in the painting. For example, his works entitled 
"Road with Cypress and/Star" , "Starry Night" and "Portrait of 
Doctor Gachet" "are illustrative examples of * this process. 

It would be desirable to provide a \computer algorithm 

which can automatically produce a "van Gogh" effect on an 

/ 

arbitrary input image . 
Summary of the invention 

It is ah object of the present invention to produce 
automatic "y&n Gogh" type effects in images. \ 

In accordance with the first aspect of the present 
inventior^ there is provided a method of automatically 
processing an image comprising locating within the image 
features having a high spatial variance and stroking the image 
with/ a series of brush strokes emanating from those^ areas 
haying high spatial variance. \ 

/ Preferably, the brush strokes have decreasing sizes \near 

/ \ 
important features of the image . \ 

\ 

Additionally, the position of a predetermined portion \>f 
ART24US * 



-2- 

brush strokes can undergo random jittering. 
Brief Description of the Drawings 

Notwithstanding any other forms which may fall within the scope 
of the present invention, preferred forms of the invention will 
now be described, by way of example only, with reference to the 
accompanying drawings which: 

Fig. 1 illustrates the major steps in the preferred 
embodiment; 

Fig. 2 illustrates the Sobel filter co-efficients utilised 
within the preferred embodiment; 

Figs. 3 & 4 illustrate the process of offsetting curves 
utilised in the preferred embodiments; 
Description of the Preferred and Other Embodiments 

The preferred embodiment is preferable implemented through 
suitable programming of a hand held camera device such as that 
described in Australian Provisional Patent Application entitled 
"Image Processing Method and Apparatus { ART01 ) " filed 
concurrently herewith by the present applicant the content of 
which is hereby specifically incorporated by cross reference. 

The aforementioned patent specification discloses a camera 
system, hereinafter known as an "Artcam" type camera, wherein 
sensed images can be directly printed out by an Artcam portable 
camera unit. Further, the aforementioned specification 

discloses means and methods for performing various 
manipulations on images captured by the camera sensing device 
leading to the production of various effects in any output 
image. The manipulations are disclosed to be highly flexible 
in nature and can be implemented through the insertion into the 
Artcam of cards having encoded thereon various instructions for 
the manipulation of images, the cards hereinafter being known 
as Artcards . The Artcam further has significant onboard 
processing power by an Artcam Central Processor unit (ACP) 
which is interconnected to a memory device for the storage of 
important data and images . 

In the preferred embodiment there is described an 
algorithm which will automatically convert a photographic image 
into a "painted" rendition of that image which replaces groups 
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of pixels in the input image with "brush strokes" in the output 
image. The algorithm works by automatically detecting dominant 
edges and propagating the edge direction information into flat 
areas of the image so that brush strokes can be oriented in 
such a way as to approximate the van Gogh style. The algorithm 
is suitable for implementation on the aforementioned Artcam 
device . 

Turning initially to Fig. 1, the algorithm comprises a 
number of steps 1. These steps include an initial step of 
filtering the image to detect its edges 2. Next, the edges are 
thresholded or "skeletonised" 4 before being processed 5 to 
determine the final edges 6. Bezier curves are then fitted to 
the edges. Next, the curves are offset 7 and brush strokes are 
placed on final image 8 . The process 7 and 8 is iterated until 
such time as the image is substantially covered by brush 
strokes. Subsequently, final "touching up" 9 of the image is 
performed. 

Turning now to describe each step in more detail. In the 
first step 2 of filtering to detect edges, a Sobel 3x3 filter 
having co-efficient sets 12 and 13 as illustrated in Fig. 2 can 
be applied to the image. The Sobel filter is a well known 
filter utilised in digital image processing and its properties 
are fully discussed in the standard text "Digital Image 
Processing" by Gonzalez and Woods published 1992 by the Addison 
- Wesley publishing company of Reading, Massachusetts at pages 
197-201. The Sobel derivative filter can be applied by either 
converting the image to greyscale before filtering or filtering 
each of the colour channels of an image separately and taking 
the maximum. The result of Sobel filtering is the production 
of a greyscale image indicating the per-pixel edge strength of 
the image . 

Next, the resultant per-pixel edge strength image is 
thresholded 3 so as to produce a corresponding thresholded 
binary image. The threshold value can be varied however, a 
value of 50% of the maximum intensity value is suitable. For 
each pixel in the edge strength image the pixel is compared 
with the threshold and if it is greater than the threshold a 
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"one" is output and if it is less than the threshold a "zero" 
is output. The result of this process is to produce a 
threshold edge map . 

Next, the thresholded edge map is "skeletonised" at step 4 
of Fig. 1. The process for skeletonising an image is fully set 
out in the aforementioned reference text at pages 491-494 and 
in other standard texts. The process of skeletonisation 
produces a "thinned" skeletonised edge map maintaining a 
substantial number of characteristics of the thresholded edge 
map . 

In a next step the edges of the skeletonised edge map are 
determined to yield a data structure which comprises a list of 
further lists of points within the image. Preferably, only 
edges having a length greater than a predetermined minimum are 
retained in the list. 

As the skeletonised image contains only single-pixel-width 
edges, possibly with multiple branches, the following algorithm 
expressed as a C++ code fragment sets out one method of 
determining or identifying the points which belong to each 
contiguous edge in the skeletonised image. It breaks branching 
edges into separate edges, and chooses to continue along the 
edge in the direction which minimises the curvature of each 
branch - ie. at a branch-point it favours following the branch 
which induces the least curvature. The code is as follows: 
void 

FollowEdges 
( 

Image& image, 

int minimumEdgeLength , 

PointListList& pointListList 

) 
( 

pointListList . Erase ( ) ; 

for (int row = 0; row < image . Height () ; row++) 
{ 

for (int col = 0; col < image . Width () ; col++) 
{ 
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If ( image [row] [col ] > 0) 
{ 

PointList pointList ; 

// append the starting point to the point 

// and clear it so we don't find it again 
pointList .Append (Point (col , row) ) ; 
image [row] [col] = 0; 



to its beginning 



accumulated so far, 



point to its end 



enough 



// follow the edge from the starting point 
FollowEdge (row, col, image, pointList); 
// reverse the order of the points 
// and follow the edge from the starting 
pointList . Reverse ( ) ; 

FollowEdge (row, col, image, pointList) ,- 

// keep the point list only if it's long 

if (pointList . Size ( ) >= minimumEdgeLength) 
pointListList . Append (pointList ) ; 



// table of row and column offsets to eight surrounding 
neighbours 

// (indexed anti-clockwise, starting east) 

static int of f setTable [8] [2] = 

{ 

{0, 1}, {-1, 1}, {-1, 0}, {-1, -1}, {0, -1}, {1, -1}, {1, 
0}, {1,1} 
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}; 

// table of preferred neighbour checking orders for given 
direction 

// (indexed anti-clockwise, starting east favouring non 
diagnals ) 

static int nextDirTable [ 8 ] [8] = 
{ 



{0, 


2, 


6, 


1, 


7, 


3, 


4, 


5) , 


{2, 


0, 


1, 


3, 


7, 


4, 


5, 


6) , 


{2, 


4, 


0, 


3, 


1, 


5, 


6, 


7} , 


{4, 


2, 


3, 


5, 


1, 


6, 


7, 


0) , 


{4, 


6, 


2, 


5, 


3, 


7, 


0, 


1} , 


{6, 


4, 


5, 


7, 


3, 


0, 


1, 


2) . 


{6, 


0, 


4, 


7, 


5, 


1, 


2, 


3}, 


{0, 


6, 


7, 


1, 


5, 


2, 


3, 


4) , 



}; 

void 

FollowEdge 
( 

int row, 
int col, 
ImageSc image , 
PointListSc pointList 

) 
{ 

Vector edgeHi story [EDGE_HISTORY_SIZE] ; 
int hi story Index = 0 ; 

for ( ; ; ) 
{ 

// table of pre-computed 

// compute tangent estimate from edge history 
Vector tangent; 

for (int i = 0; i < EDGE_H I STORY_S I Z E ; i++) 
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tangent += edgeHistory [ i ] ; 
// determine tangent angle and quantize to eight 

directions 

// (direction zero corresponds to the range -PI/8 to 
+PI/8, i.e east) 

double realAngle = tangent . Angle ( ) ,- 

int angle = (int) ((realAngle * 255) / (2 * PI) + 

0.5) ; 

int dir = ((angle - 16 + 256) % 256) / 32; 

// try surrounding pixels, fanning out from 

preferred 

// (i.e. edge) direction 

int* pNextDir = nextDirTable [dir ] ; 

bool bFound = false ; 

for (i = 0; i < 8; i + +) 
{ 

// determine row and column offset for 

current direction 

int rowOffset = of f setTable [dir ][ 0 ] ; 

int colOffset = of f setTable [dir ][ 1 ] ; 

// done testing neighbours if edge pixel 

found 

if (image [row + rowOffset] [col + 

colOffset] > 0) 

{ 

// determine edge pixel address 

Point oldPoint (col, row) ; 

row += rowOffset; 

col += colOffset; 

Point newPoint (col, row) ; 
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tangent = newPoint - oldPoint; 
tangent . Normalize ( ) ; 

edgeHi s t ory [his troy Index ] = tangent ; 
historylndex = (historylndex + 1) % 

EDGE_H I STOR Y_S I Z E ; 

// append edge pixel to point list 
pointList .Append (newPoint ) ; 

// clear edge pixel, so we don't find 

image [row] [col] = 0; 
bFound = true; 
break; 

} 

// determine next direction to try 
dir = pNextDir[i]; 

} 

// done following edge if no edge pixel found 
if ( ! bFound) 
break; 



The result of utilising this algorithmic component on the 
skeletonised edgemap is to produce a list of edges having at 
least a predetermined size. A suitable size was found to be a 
length of 20 pixel elements. 

In the next step 6 of Fig. 1, Bezier curves are fitted to 
each of the edge lists derived from step 5. For each list of 
edges, a piece wise Bezier curve is fitted to the corresponding 
list of points. A suitable algorithm for fitting the piece 
wise Bezier curve is Schneider's curve fitting algorithm as set 
out in Schneider, P.J., "An Algorithm for Automatically Fitting 
Digitised Curves", in Glassner , A. S . (Ed.), Graphics Gems, 
Academic Press, 1990. This algorithm provides quick 
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convergence to a good fit which aims only for geometric 
continuity and not parametric continuity. Schneider's 
algorithm is recursive, such that if the fit is poor, is sub- 
divides the curve at the .point of maximum error and fits the 
curves to the two halves separately. Next an estimate of the 
tangent at the split point is derived using only the two points 
on either side of the split point. For dense point sets, this 
tends to amplify the local noise. An improved quality of curve 
fitting can be alternatively undertaken by using points further 
away from the split point as the basis for the tangent. 

In the next steps 7 of Fig. 1, the curves are offset from 
the primary curve list by half a desired "brush stroke width" . 
The offsetting occurring on both sides of the primary curve 
list with the result being two curves approximately one stroke 
width apart from one another which run parallel to and on 
either side of the original primary curve. 

The following algorithm is utilized to generate a piece 
wise Bezier curves which are approximately parallel to a 
specified piece wise Bezier curves and includes the steps. 

i. Create an empty point list. 

ii . Create and empty tangent (vector) list. 

iii. Evaluate selected points on each curve segment making 
up the piece-wise curve and offset them by the specified offset 
value. Append the offset points to the point list, and their 
corresponding tangents to the tangent list. This process is 
described below with reference to Fig. 2 and 3. 

iv. Fit a piece-wise Bezier curve to the resultant point 
list. Rather than estimating tangents during the curve-fitting 
process, use the exact tangents associated with the offset 
points . 

Offset each curve segment as follows: 

i. Evaluate the curve value, normalised tangent and 
normalised normal normalised to the size of the image for a set 
of evenly-spaced parameter value between (and including) 0.0 
and 1.0 (eg. a spacing of 0.25) . 

ii . Scale the normals by the specified offset value. 

iii. Construct line segments using the curve points and 
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scaled normals. 

iv. If any two line segments intersect, eliminate the 
point associated with one of them. 

v. Append the surviving points to the point list, and 
append their corresponding tangents to the tangent list. Only 
append the point associated with parameter value 1.0 if the 
segment in question is the last in the piece-wise curve, 
otherwise it will duplicate the point associated with parameter 
value 0 . 0 of the next segment . 

The process of offsetting each curve segment can proceed 
as following: 

1. Firstly, for a set of evenly spaced parameter values 
on the Bezier curve between (and including) 0.0 and 1.0, for 
each parameter value PN (Fig. 3) the curve value 3 0 a 
normalised tangent 31 and normalised normal 32 are calculated. 

2. Next, the normals 32 are scaled 34 by a specified 
offset value. 

3. Next a line segment from the point 3 0 to a point 36, 
which is at the end of the scaled normal 3 4 is calculated. 

4. Next, the line segment 30, 3 6 is checked against 
corresponding line segments for all other points on the curve 
eg. 38, 39. If any two line segments intersect, one of the 
points 3 6 is discarded. 

5. The surviving points are appended to the point list 
and their corresponding tangents are appended to the tangent 
list. The point associated with the parameter value 1.0 is 
appended only if the segment in question is the .last in the 
piece-wise curve segment. Otherwise, it will duplicate the 
point associated with the parameter value 0.0 of the next 
segment . 

Turning to Fig. 4, the end result of the offset of curves 
in accordance with step 7 of Fig. 1 is to produce for a series 
of Bezier curve segments CI, C2 etc. Firstly, a series of 
parametrically spaced points, Pi - P5 . Next, the normalisation 
points Nl - N5 are produced (corresponding through to point 3 6 
of Fig. 3), for each of the points PI - P5 . Next, the 
resultant piece-wise Bezier curve segment 40 is produced by 
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utilising the points in 1 - N5 . This process is then repeated 
for the opposite curve comprising the points N6 - N10 and curve 
41. This process is then repeated for each of the subsequent 
piece-wise curves C2 etc. The result is the two curves of 40, 
41 being substantially parallel to one another and having a 
spaced apart width of approximately one brush stroke. 

Next, a series of brush strokes are placed into the output 
image along the curves . The strokes are oriented in accordance 
with the curve tangent direction. Each brush stroke is defined 
to have a foot print which defines where it may not overlap 
with other brush strokes. A brush stroke may only be place 
along the curve if its foot print does not conflict with the 
foot prints already present in the output image. Any curves 
that do not have any brush strokes placed along them are 
discarded and the process of steps 7 and 8 are iterated in a 
slightly modified form until no curves are left. The slightly 
modified form of step 7 is to offset the curves by one brush 
stroke in the outward direction rather than the half brush 
stroke necessary when offsetting curves from the curve CI of 
Fig. 4. 

It has been found by utilisation of the above method that 
the result produced consists of a series of brush strokes which 
emanate from objects of interest within the image. 

Subsequent to covering the image with brush strokes of a 
given size, further processing steps can be undertaken with 
smaller and smaller brush strokes and increasing derivative 
threshold levels so as to more accurately "brush stroke" 
important features in the image. Such a technique is similar 
to that used by van Gogh in certain portions of his images 
where details are required. 

It would be appreciated by a person skilled in the art 
that numerous variations and/or modifications may be made to 
the present invention as shown in the specific embodiment 
without departing from the spirit or scope of the invention as 
broadly described. The present embodiment is, therefore, to be 
considered in all respects to be illustrative and not 
restrictive . 
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Ink Jet Technologies 

The embodiments of the invention use an ink jet printer 
type device. Of course many different devices could be used. 
However presently popular ink jet printing technologies are 
unlikely to be suitable. 

The most significant problem with thermal inkjet is power 
consumption. This is approximately 100 times that required for 
high speed, and stems from the energy-inefficient means of drop 
ejection. This involves the rapid boiling of water to produce a 
vapor bubble which expels the ink. Water has a very high heat 
capacity, and must be superheated in thermal inkjet 
applications. This leads to an efficiency of around 0.02%, from 
electricity input to drop momentum (and increased surface area) 
out . 

The most significant problem with piezoelectric inkjet is 
size and cost. Piezoelectric crystals have a very small 
deflection at reasonable drive voltages, and therefore require 
a large area for each nozzle. Also, each piezoelectric actuator 
must be connected to its .drive circuit on a separate substrate. 
This is not a significant problem at the current limit of 
around 3 00 nozzles per print head, but is a major impediment to 
the fabrication of pagewide print heads with 19,2 00 nozzles. 

Ideally, the inkjet technologies used meet the stringent 
requirements of in-camera digital color printing and other high 
quality, high speed, low cost printing applications. To meet 
the requirements of digital photography, new inkjet 
technologies have been created. The target features include: 

low power (less than 10 Watts) 

high resolution capability (1,600 dpi or more) 
photographic quality output 
low manufacturing cost 

small size (pagewidth times minimum cross section) 
high speed (< 2 seconds per page) . 

All of these features can be met or exceeded by the inkjet 
systems described below with differing levels of difficulty. 45 
different inkjet technologies have been developed by the 
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Assignee to give a wide range of choices for high volume 
manufacture. These technologies form part of separate 

applications assigned to the present Assignee as set out in the 
table below. 

The inkjet designs shown here are suitable for a wide 
range of digital printing systems, from battery powered one- 
time use digital cameras, through to desktop and network 
printers, and through to commercial printing systems 

For ease of manufacture using standard process equipment, 
the print head is designed to be a monolithic 0.5 micron CMOS 
chip with MEMS post processing. For color photographic 
applications, the print head is 100 mm long, with a width which 
depends upon the inkjet type. The smallest print head designed 
is IJ38, which is 0.35 mm wide, giving a chip area of 35 square 
mm. The print heads each contain 19,2 00 nozzles plus data and 
control circuitry. 

Ink is supplied to the back of the print head by injection 
molded plastic ink channels. The molding requires 50 micron 
features, which can be created using a lithographically 
micromachined insert in a standard injection molding tool. Ink 
flows through holes etched through the wafer to the nozzle 
chambers fabricated on the front surface of the wafer. The 
print head is connected to the camera circuitry by tape 
automated bonding . 
Cross-Ref erenced Applications 

The following table is a guide to cross-referenced patent 
applications filed concurrently herewith and discussed 
hereinafter with the reference being utilized in subsequent 
tables when referring to a particular case: 



Docket 
No. 


Reference 


Title 


IJ01US 


IJ01 


Radiant Plunger Ink Jet Printer 


IJ02US 


IJ02 


Electrostatic Ink Jet Printer 


IJ03US 


IJ03 


Planar Thermoelastic Bend Actuator Ink Jet 


IJ04US 


IJ04 


Stacked Electrostatic Ink Jet Printer 


IJ05US 


IJ05 


Reverse Spring Lever Ink Jet Printer 


IJ06US 


IJ06 


Paddle Type Ink Jet Printer 


IJ07US 


IJ07 


Permanent Magnet Electromagnetic Ink Jet Printer 


IJ08US 


IJ08 


Planar Swing Grill Electromagnetic Ink Jet Printer 
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IJ09US 


IJ09 


Pump Action Refill Ink Jet Printer 


IJ10US 


IJIO 


Pulsed Magnetic Field Ink Jet Printer 


IJ11US 


IJ11 


Two Plate Reverse Firing Electromagnetic Ink Jet Printer 


IJ12US 


U12 


Linear Stepper Actuator Ink Jet Printer 


IJ13US 


IJ13 


Gear Driven Shutter Ink Jet Printer 


IJ14US 


IJ14 


Tapered Magnetic Pole Electromagnetic Ink Jet Printer 


IJ15US 


D15 


Linear Spring Electromagnetic Grill Ink Jet Printer 


IJ16US 


U16 


Lorenz Diaphragm Electromagnetic Ink Jet Printer 


IJ17US 


IJ17 


PTFE Surface Shooting Shuttered Oscillating Pressure Ink Jet 
Printer 


IJ18US 


IJ18 


Buckle Grip Oscillating Pressure Ink Jet Printer 


IJ19US 


IJ19 


Shutter Based Ink Jet Printer 


IJ20US 


IJ20 


Curling Calyx Thermoelastic Ink Jet Printer 


IJ21US 


IJ21 


Thermal Actuated Ink Jet Printer 


IJ22US 


IJ22 


Iris Motion Ink Jet Printer 


IJ23US 


U23 


Direct Firing Thermal Bend Actuator Ink Jet Printer 


IJ24US 


IJ24 


Conductive PTFE Ben Activator Vented Ink Jet Printer 


IJ25US 


IJ25 


Magnetostrictive Ink Jet Printer 


IJ26US 


IJ26 


Shape Memory Alloy Ink Jet Printer 


IJ27US 


IJ27 


Buckle Plate Ink Jet Printer 


IJ28US 


IJ28 


Thermal Elastic Rotary Impeller Ink Jet Printer 


IJ29US 


IJ29 


Thermoelastic Bend Actuator Ink Jet Printer 


IJ30US 


IJ30 


Thermoelastic Bend Actuator Using PTFE and Corrugated Copper 
Ink Jet Printer 


IJ31US 


IJ31 


Bend Actuator Direct Ink Supply Ink Jet Printer 


IJ32US 


IJ32 


A High Young's Modulus Thermoelastic Ink Jet Printer 


IJ33US 


IJ33 


Thermally actuated slotted chamber wall ink jet printer 


IJ34US 


IJ34 


Ink Jet Printer having a thermal actuator comprising an external 
coiled spring 


IJ35US 


IJ35 


Trough Container Ink Jet Printer 


IJ36US 


IJ36 


Dual Chamber Single Vertical Actuator Ink Jet 


IJ37US 


IJ37 


Dual Nozzle Single Horizontal Fulcrum Actuator Ink Jet 


IJ38US 


IJ38 


Dual Nozzle Single. Horizontal Actuator Ink Jet 


IJ39US 


IJ39 


A single bend actuator cupped paddle ink jet printing device 


IJ40US 


IJ40 


A thermally actuated ink jet printer having a series of thermal 
actuator units 


IJ41US 


IJ41 


A thermally actuated ink jet printer including a tapered heater 
element 


IJ42US 


IJ42 


Radial Back-Curling Thermoelastic Ink Jet 


IJ43US 


IJ43 


Inverted Radial Back-Curling Thermoelastic Ink Jet 


IJ44US 


IJ44 


Surface bend actuator vented ink supply ink jet printer 


IJ45US 


IJ45 


Coil Acutuated Magnetic Plate Ink Jet Printer 



Tables of Drop -on -Demand Ink jets 

Eleven important characteristics of the fundamental 
operation of individual ink jet nozzles have been identified. 
These characteristics are largely orthogonal, and so can be 
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elucidated as an eleven dimensional matrix. Most of the eleven 
axes of this matrix include entries developed by the present 
assignee . 

The following tables form the axes of an eleven 
dimensional table of ink jet types. 
Actuator mechanism (18 types) 
Basic operation mode (7 types) 
Auxiliary mechanism (8 types) 

Actuator amplification or modification method (17 types) 
Actuator motion (19 types) 
Nozzle refill method (4 types) 

Method of restricting back-flow through inlet (10 types) 
Nozzle clearing method (9 types) 
Nozzle plate construction (9 types) 
Drop ejection direction (5 types) 
Ink type (7 types) 

The complete eleven dimensional table represented by these 
axes contains 3 6.9 billion possible configurations of inkjet 
nozzle. While not all of the possible combinations result in a 
viable inkjet technology, many million configurations are 
viable. It is clearly impractical to elucidate all of the 
possible configurations. Instead, certain inkjet types have 
been investigated in detail. These are designated IJ01 to IJ45 
above . 

Other inkjet configurations can readily be derived from 
these 45 examples by substituting alternative configurations 
along one or more of the 11 axes. Most of the IJ01 to IJ45 
examples can be made into inkjet print heads with 
characteristics superior to any currently available inkjet 
technology. 

Where there are prior art examples known, to the inventor, 
one or more of these examples are listed in the examples column 
of the tables below. The IJ01 to IJ45 series are also listed in 
the examples column. In some cases, a printer may be listed 
more than once in a table, where it shares characteristics with 
more than one entry. 
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Suitable applications include: Home printers, Office 
network printers, Short run digital printers, Commercial print 
systems, Fabric printers, Pocket printers, Internet WWW 
printers, Video printers, Medical imaging, Wide format 
printers, Notebook PC printers, Fax machines, Industrial 
printing systems, Photocopiers, Photographic minilabs etc. 

The information associated with the aforementioned 1 
dimensional matrix are set out in the following tables. 
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Ink Jet Printing 

A large number of new forms of ink jet printers have been 
developed to facilitate alternative ink jet technologies for the 
image processing and data distribution system. Various 
combinations of ink jet devices can be included in printer 
devices incorporated as part of the present invention. 
Australian Provisional Patent Applications relating to these ink 
jets which are specifically incorporated by cross reference 
include : 



Australian 
Provisional 
Number 


Filing Date 


Title 


PO8066 


15-Jul-97 


Image Creation Method and Apparatus (IJ01) 


PO8072 


15-Jul-97 


Image Creation Method and Apparatus (IJ02) 


PO8040 


15-Jul-97 


Image Creation Method and Apparatus (IJ03) 


PO807 1 


15-JuI-97 


Image Creation Method and Apparatus (IJ04) 


PO8047 


15-Jul-97 


Image Creation Method and Apparatus (IJ05) 


PO8035 


15-Jul-97 


Image Creation Method and Apparatus (IJ06) 


rHJo(J44 


1 3-Jul-y / 


Image Creation Method and Apparatus (IJ07) 


PUoUo3 




Image Creation Method and Apparatus (IJ08) 


FUoU3 / 


1 j-Jul-9 / 


Image Creation Method and Apparatus (IJ09) 




I j-JuI-9 / 


Image Creation Method' and Apparatus (IJ 1 0) - 


PUoUoy 


1 ^ Till Q*7 


Image Creation Method and Apparatus (IJ 1 1) 






lllJd^C v^ICalHJll IVICIIIUU till (J /AppdltllUb \±J 1 Z.) 


PO8036 


15-Jul-97 


Image Creation Method and Apparatus (IJ 13) 


PO8048 


15-Jul-97 


Image Creation Method and Apparatus (IJ 14) 


PO8070 


15-Jul-97 


Image Creation Method and Apparatus (IJ 1 5) 


PO8067 


15-Jui-97 


Image Creation Method and Apparatus (IJ 1 6) 


PO8001 


15-JuI-97 


Image Creation Method and Apparatus (I J 1 7) 


PO8038 


15-Jul-97 


Image Creation Method and Apparatus (IJ 1 8) 


PO8033 


15-Jul-97 


Image Creation Method and Apparatus (IJ 1 9) 


PO8002 


15-Ju1-97 


Image Creation Method and Apparatus (IJ20) 


PO8068 


15-Jul-97 


Image Creation Method and Apparatus (IJ21) 


PO8062 


15-Jul-97 


Image Creation Method and Apparatus (IJ22) 


PO8034 


15-Jul-97 


Image Creation Method and Apparatus (IJ23) 


PO8039 


15-Jul-97 


Image Creation Method and Apparatus (IJ24) 


PO8041 


15-Jul-97 


Image Creation Method and Apparatus (IJ25) 


PO8004 


15-Jul-97 


Image Creation Method and Apparatus (IJ26) 
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PO8037 


I5-Jul-97 


Image Creation Method and Apparatus (IJ27) 


PO8043 


15-Jul-97 


Image Creation Method and Apparatus (IJ28) 


PO8042 


15-Jul-97 


Image Creation Method and Apparatus (IJ29) 


PO8064 


15-Jul-97 


Image Creation Method and Apparatus (IJ30) 


P09389 


23-Sep-97 


Image Creation Method and Apparatus (IJ31) 


P0939 1 


23-Sep-97 


Image Creation Method and Apparatus (IJ32) 


PP0888 


1 2-Dec-97 


Image Creation Method and Apparatus (IJ33) 


PP089 1 


12-Dec-97 


Image Creation Method and Apparatus (IJ34) 


PP0890 


12-Dec-97 


Image Creation Method and Apparatus (IJ35) 


PP0873 


12-Dec-97 


Image Creation Method and Apparatus (IJ36) 


PP0993 


12-Dec-97 


Image Creation Method and Apparatus (IJ37) 


PP0890 


12-Dec-97 


Image Creation Method and Apparatus (IJ38) 


PP1398 


19-Jan-98 


An Image Creation Method and Apparatus (IJ39) 


PP2592 


25-Mar-98 


An Image Creation Method and Apparatus (IJ40) 


PP2593 


^- ~> ivi at Z7 (j 


image creation Metnod and- Apparatus (IJ41) 


PP3991 


9-Jun-98. 


Image Creation Method and Apparatus (IJ42) 


PP3987 


9-Jun-98 


Image Creation Method and Apparatus (IJ43) 


PP3985 


9-Jun-98 


Image Creation Method and Apparatus (IJ44) 


PP3983 


9-Jun-98 


Image Creation Method and Apparatus ( IJ45) 



Ink Jet Manufacturing 

Further, the present application may utilize advanced 
semiconductor fabrication techniques in the construction of large 
arrays of ink jet printers. Suitable manufacturing techniques 
are described in the following. Australian provisional patent 
specifications incorporated here by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


P07935 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM01) 


P07936 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM02) 


P07937 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM03) 


PO8061 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM04) 


PO8054 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM05) 


PO8065 


15-JuI-97 


A Method of Manufacture of an Image Creation Apparatus (IJM06) 


PO8055 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM07) 


PO8053 


15-JuI-97 


A Method of Manufacture of an Image Creation Apparatus (IJM08) 


PO8078 


15-JuI-97 


A Method of Manufacture of an Image Creation Apparatus (IJM09) 
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P07933 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM10) 


PO7950 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 1 1 ) 


P07949 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 1 2) 


PO8060 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 13) 


PO8059 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 14) 


PO8073 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 15) 


PO8076 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 16) 


PO8075 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 17) 


PO8079 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 18) 


PO8050 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM 1 9) 


PO8052 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM20) 


P07948 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM21) 


P07951 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM22) 


PO8074 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM23) 


P07941 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM24) 


PO8077 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM25) 


PO8058 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM26) 


PO8051- 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM27) 


PO8045 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM28) 


P07952 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM29) 


PO8046 


15-Jul-97 


A Method of Manufacture of an Image Creation Apparatus (IJM30) 


PO8503- 


1 l-Aug-97 


A Method of Manufacture of an Image Creation Apparatus (IJM30a) 


PO9390 


23-Sep-97 


A Method of Manufacture of an. Image Creation Apparatus (IJM31). 


P09392 


23-Sep-97 


A Method of Manufacture of an Image Creation Apparatus (IJM32V 


PP0889 


12-Dec-97 


A Method- of Manufacture of an Image Creation Apparatus (IJM35) 


PP0887 


12-Dec-97 


A Method of Manufacture of an Image Creation Apparatus (IJM36)- 


PP0882 


12-Dec-97 


A Method of Manufacture of an Image Creation Apparatus (IJM37)" 


PP0874 


12-Dec-97 


A Method of Manufacture of an Image Creation Apparatus (IJM38) 


PP1396 


19-Jan-98 


A Method of Manufacture of an Image Creation Apparatus (IJM39) 


PP2591 


25-Mar-98 


A Method of Manufacture of an Image Creation Apparatus (IJM41) 


PP3989 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM40) 


PP3990. 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM42) 


PP3986 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM43) 


PP3984 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM44) 


PP3982 


9-Jun-98 


A Method of Manufacture of an Image Creation Apparatus (IJM45) 
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Fluid Supply 

Further, the present application may utilize an ink delivery 
system to the ink jet head. Delivery systems relating to the 
supply of ink to a series of ink jet nozzles are described in the 
following Australian provisional patent specifications, the 
disclosure of which are hereby incorporated by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


PO8003 


15-Jul-97 


Supply Method and Apparatus (Fl) 


PO8005 


15-Jul-97 


Supply Method and Apparatus (F2) 


PO9404 


23-Sep-97 


A Device and Method (F3) 



MEMS Technology 



Further, the present application may utilize advanced 
semiconductor microelectromechanical techniques in the 
construction of large arrays of ink jet printers. Suitable 
microelectromechanical techniques are described in the following 
Australian provisional patent specifications incorporated here by 
cross-reference : 



Australian 
Provisional 
Number 


Filing Date 


Title 


P07943 


15-Jul-97 


A device (MEMS01) 


PO8006 


15-Jul-97 


A device (MEMS02) 


PO8007 


15-Jul-97 


A device (MEMS03) 


PO8008 


15-Jul-97 


A device (MEMS04) 


PO8010 


15-Jul-97- 


A device (MEMS05) 


PO8011 


15-Jul-97 


A device (MEMS06) 


P07947 


15-Jul-97 


A device (MEMS07) 


P07945 


15-Jul-97 


A device (MEMS08) 


P07944 


15-Jul-97 


A device (MEMS09) 


P07946 


15-Jul-97 


A device (MEMS 10) 


P09393 


23-Sep-97 


A Device and Method (MEMS 1 1) 


PP0875 


12-Dec-97 


A Device (MEMS 12) 


PP0894 


12-Dec-97 


A Device and Method (MEMS 13) 
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IR Technologies 

Further, the present application may include the utilization 
of a disposable camera system such as those described in the 
following Australian provisional patent specifications 
5 incorporated here by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


PP0895 


12-Dec-97 


An Tmape CYeation Method and Annaratus fTROI^ 


PP0870 


1 2-Dec-97 


A Device and Method (fRO?^ 


PP0869 


1 2-Dec-97 


A Device and Method CTR04 > i 


PP0887 


12-Dec-97 


Image Creation Method and Apparatus (IR05) 


PP0885 


12-Dec-97 


An Image Production System (IR06) 


PP0884 


12-Dec-97 


Image Creation Method and Apparatus (IR10) 


PP0886 


12-Dec-97 


Image Creation Method and Apparatus (IR12) 


PP0871 


12-Dec-97 


A Device and Method (IR1 3) 


PP0876 


12-Dec-97 


An Image Processing Method and Apparatus (IR14) 


PP0877 


12-Dec-97 


A Device and Method (IR16) 


PP0878 


12-Dec-97 


A Device and Method (IR17) 


PP0879 


12-Dec-97 


A Device and Method (IR18) 


PP0883 


12-Dec-97 


A Device and Method (IR19) 


PP0880 


12-Dec-97 


A Device and Method (IR20) 


PP0881 


12-Dec-97 


A Device and Method (IR21) 



DotCard Technologies 

Further, the present application may include the utilization 
0 of a data distribution system such as that described in the 
following Australian provisional patent specifications 
incorporated here by cross-reference: 



Australian 
Provisional 
Number 


Filing Date 


Title 


PP2370 


16-Mar-98 


Data Processing Method and Apparatus (DotOl) 


PP2371 


16-Mar-98 


Data Processing Method and Apparatus (Dot02) 
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Art cam Technologies 

Further, the present application may include the utilization 
of camera and data processing techniques such as an Artcam type 
device as described in the following Australian provisional 



5 patent specifications incorporated here by cross-reference: 





Australian 
Provisional 
Number 


Filing Date 


Title 




P07991 


15-Jul-97 


Image Processing Method and Apparatus (ART01) 




PO8505 


ll-Aug-97 


Image Processing Method and Apparatus (ARTO 1 a) 




P07988 


15-Jul-97 


Image Processing Method and Apparatus (ART02) 




P07993 


15-Jul-97 


Image Processing Method and Apparatus (ART03) 




PO8012 


15-Jul-97 


Image Processing Method and Apparatus (ART05) 


a 


PO8017 


15-Jul-97 


Image Processing Method and Apparatus (ART06) 




PO8014- 


15-Jul-97 


Media Device (ART07) 




PO8025 


15-Jul-97 


Image Processing Method and Apparatus (ART08) 


§y 


PO8032 


15-Jul-97 


Image Processing Method and Apparatus (ART09) 




P07999 


15-Jul-97 


Image Processing Method and Apparatus (ART 1 0) 




P07998 


15-Jul-97 


Image Processing Method and Apparatus (ART1 1) 




PO8031 


15-Jul-97 


Image Processing Method and Apparatus (ART 12) 




PO8030 


15-Jul-97 


Media Device (ART 13) 




P08498 


ll-Aug-97 


Image Processing Method and Apparatus (ART 14) 




P07997 


15-Jul-97 


Media Device (ART 15) 




P07979 


1 5-Jul-97 


Med i a Devi ce (ART 1 6) 




PO8015 


15-Jul-97 


Media Device (ART 17) 




P07978 


15-Jul-97 


Media Device (ART 18) 




P07982. 


15-Jul-97 


Data Processing Method and Apparatus (ART 19) 




P07989 


15-Jul-97 


Data Processing Method and Apparatus (ART20) 




PO8019 


15-Jul-97 


Media Processing Method and Apparatus (ART21) 




PO7980 


15-Jul-97 


Image Processing Method and Apparatus (ART22) 




P07942 


15-Jul-97 


Image Processing Method and Apparatus (ART23) 




PO8018 


15-Jul-97 


Image Processing Method and Apparatus (ART24) 




P07938 


15-Jul-97 


Image Processing Method and Apparatus (ART25) 




PO8016 


15-Jul-97 


Image Processing Method and : Apparatus (ART26) 




PO8024 


15-Jul-97 


Image Processing Method and Apparatus (ART27) 




PO7940 


15-Jul-97 


Data Processing Method and Apparatus (ART28) 




P07939 


15-Jul-97 


Data Processing Method and Apparatus (ART29) 




PO8501 


1 l-Aug-97 


Image Processing Method and Apparatus (ART30) 
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PO8500 


1 1 -Aug-97 


Image Processing Method and Apparatus (ART3 1) 


P07987 


15-Jul-97 


Data Processing Method and Apparatus (ART32) 


PO8022 


15-Jul-97 


Image Processing Method and Apparatus (ART33) 


P08497 


1 1 - Aug-97 


Image Processing Method and Apparatus (ART30) 


PO8029 


15-Jul-97 


Sensor Creation Method and Apparatus (ART36) 


P07985 


15-Jul-97 


Data Processing Method and Apparatus (ART37) 


PO8020 


15-Jul-97 


Data Processing Method and Apparatus (ART38) 


PO8023 


15-Jul-97 


Data Processing Method and Apparatus (ART39) 


P09395 


23-Sep-97 


Data Processing Method and Apparatus (ART4) 


PO8021 


15-Jul-97 


Data Processing Method and Apparatus (ART40) 


PO8504 


11 -Aug-97 


Image Processing Method and Apparatus (ART42) 


PO8000 


15-Jul-97 


Data Processing Method and Apparatus (ART43) 


P07977 


15-Jul-97 


Data Processing Method and Apparatus (ART44) 


P07934. 


15-Jul-97 


Data Processing Method and Apparatus (ART45) 


PO7990 


15-Jul-97 


Data Processing Method and~ Apparatus (ART46) 


P08499 


11 -Aug-97 


Image Processing Method and Apparatus (ART47) 


PO8502 


ll-Aug-97 


Image Processing Method and Apparatus (ART48) 


P07981 


15-Jul-97 


Data Processing Method and Apparatus (ART50) 


P07986 


15-Jul-97 


Data Processing Method and Apparatus (ART51) 


P07983 


15-Jul-97 


Data Processing Method and Apparatus (ART52) 


PO8026 


15-Jul-97 


Image Processing Method and Apparatus (ART53) 


PO8027 


15-Jul-97 


Image Processing Method and Apparatus (ART54) 


PO8028 


15-Jul-97 


Image Processing Method and Apparatus (ART56) 


P09394- 


23-Sep-97- 


Image Processing Method and Apparatus (ART57) 


P09396 


23-Sep-97 


Data Processing Method and Apparatus (ART58) 


P09397 


23-Sep-97 


Data Processing Method and Apparatus (ART59) 


P09398 


23-Sep-97 


Data Processing Method and Apparatus (ART60) 


P09399 


23-Sep-97 


Data Processing Method and Apparatus (ART61) 


PO9400 


23-Sep-97 


Data Processing Method and Apparatus (ART62) 


PO940I 


23-Sep-97 


Data Processing Method and'Apparatus (ART63) 


PO9402 


23-Sep-97 


Data Processing Method and Apparatus (ART64) 


PO9403 


23-Sep-97 


Data Processing Method and Apparatus (ART65) 


PO9405 


23-Sep-97 


Data Processing Method and Apparatus (ART66) 


PP0959 


16-Dec-97 


A Data Processing Method and Apparatus (ART68) 


PP1397 


19-Jan-98 


A Media Device (ART69) 
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